Papers with audio-video understanding
ROMA: Real-time Omni-Multimodal Assistant with Interactive Streaming Understanding (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing omni-multimodal large language models lack incomplete modality support or lack autonomous proactive monitoring. |
| Approach: | They propose a real-time omni-multimodal assistant for unified reactive and proactive interaction that decouples response initiation from generation to ensure precise triggering without task conflict. |
| Outcome: | The proposed model achieves state-of-the-art performance on proactive tasks while competing in reactive settings. |